Training a sigmoidal network is difficult
نویسنده
چکیده
In this paper we s h o w that the loading problem for a 3-node architecture with sigmoidal activation is NP-hard if the input dimension varies, if the classiication is performed with a certain accuracy, and if the output weights are restricted.
منابع مشابه
Feasibility of Training and Investigation into Training of Sigmoidal FFANN with Gaussian Learning Rate and Zero Weight Initializations
Artificial Neural Networks(ANN) has applications in the various fields. Non linear transformation problems can be solved using ANN. Generally the parameter weight is initialized to some random value. In this paper we have used Sigmoidal FFANN. The training is done using Gaussian learning rate and weights are initialized to zero. It is found that the training of Sigmoidal FFANN can be done even ...
متن کاملConstructive Neural Networks: a Review
In conventional neural networks, we have to define the architecture prior to training but in constructive neural networks the network architecture is constructed during the training process. In this paper, we review constructive neural network algorithms that constructing feedforward architecture for regression problems. Cascade-Correlation algorithm (CCA) is a well-known and widely used constr...
متن کاملروش پیشتعلیم سریع بر مبنای کمینهسازی خطا برای همگرائی یادگیری شبکههای عصبی با ساختار عمیق
In this paper, we propose efficient method for pre-training of deep bottleneck neural network (DBNN). Pre-training is used for initial value of network weights convergence of DBNN is difficult because of different local minimums. While with efficient initial value for network weights can avoided some local minimums. This method divides DBNN to multi single hidden layer and adjusts them, then we...
متن کاملTraining Feedforward Neural Networks with Standard Logistic Activations is Feasible
Training feedforward neural networks with standard logistic activations is considered difficult because of the intrinsic properties of these sigmoidal functions. This work aims at showing that these networks can be trained to achieve generalization performance comparable to those based on hyperbolic tangent activations. The solution consists on applying a set of conditions in parameter initiali...
متن کاملEvaluation of Ultimate Torsional Strength of Reinforcement Concrete Beams Using Finite Element Analysis and Artificial Neural Network
Due to lack of theory of elasticity, estimation of ultimate torsional strength of reinforcement concrete beams is a difficult task. Therefore, the finite element methods could be applied for determination of strength of concrete beams. Furthermore, for complicated, highly nonlinear and ambiguous status, artificial neural networks are appropriate tools for prediction of behavior of such states. ...
متن کامل